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1. Summary 

This paper presents the theoretical development of a modified optimal control pilot model 
based upon the optimal control model (OCM) of the human operator developed by Kleinman, 
Baron, and Levison ( Automatica , May 1970). This model is input compatible with the OCM and 
retains other key aspects of the OCM, such as a linear quadratic solution for the pilot gains with 
inclusion of control rate in the cost function, a Kalman estimator, and the ability to account for 
attention allocation and perception threshold effects. Unlike the OCM, however, the structure 
of this model allows for direct calculation of pilot and system transfer functions in pole-zero 
form. An algorithm designed for easy implementation in current dynamic systems analysis and 
design software is presented. This implementation may be used for interactive modification of 
pilot-plant parameters, direct calculation of system and pilot transfer functions, system transfer 
function manipulation, and determination of system frequency responses. Example results 
based upon the analysis of a tracking task using three basic dynamic systems are compared 
with measured results and with similar analyses performed with the OCM and two previously 
proposed simplified optimal pilot models. The pilot frequency responses and error statistics 
obtained with this modified optimal control model arc shown to compare more favorably with 
the measured results than the other previously proposed simplified models evaluated. Also, the 
impact on the modelling results of changing the approximation of the pilot’s effective time delay 
is presented. 

2. Introduction 

Manual vehicular control system analysis, commonly referred to as pilot modelling, 1ms 
been a useful tool for the analysis of pilot-in-the-loop systems. Research into the modelling 
of the pilot control behavior has its origins in studies of the human operator performed in 
the 1940’s (Elkind 1964). From then until the 1960’s, research was predominantly devoted to 
understanding the human as a controller of single- input /single-out put systems using frequency 
domain models (McRuer 1980). Since the 1960’s, research has concentrated on the analysis 
of more complex mult ivariate systems. Two basic approaches to analyzing these systems have 
emerged. One is based upon extending the frequency domain methods and insights developed 
for single-input/single-output systems to the multivariate case, and the other is based upon 
time domain methods and optimization theory (Innocenti 1988). This report focuses on a time 
domain approach. 

The first attempt to describe the behavior of the human pilot in a time domain optimal 
control framework, the optimal control model (OCM), was by Kleinman, Baron, and Levison 
(Kleinman, Baron, and Levison 1970; Baron, Kleinman, and Levison 1970). The OCM is 
based upon the assumption that the well-trained and motivated human controller behaves 
optimally in some sense, adjusting the pilot’s compensation for a given vehicle and task, 
subject to human limitations. The OCM has been widely used and has been validated in a 
number of tasks. It has been used to model task performance and to assess flying qualities, to 
model human-controller-describing functions, and for both the analysis and synthesis of manual 
control loops (Innocenti 1988). In the OCM, the pilot’s compensation is modelled by linear- 
quadratic- regulator gains (Kwakernaak and Sivan 1972), a Kalman-Bucy filter (Kwakernaak 
and Sivan 1972), and a linear predictor (Kleinman, Baron, and Levison 1970). 

This paper presents the theoretical development of a modified optimal control pilot model 
(MOCM) based upon the OCM of Kleinman, Baron, and Levison. This MOCM is a variation 
of simplified optimal pilot models developed by Hess (1976), Schmidt (1979 and 1981), and 
Broussard and Stengel (1977). This model is input compatible with the OCM and retains other 
key aspects of the OCM. Unlike the OCM, however, the structure allows for the direct calculation 
of pilot and system transfer functions in pole-zero form and is designed for easy implementation 



in current dynamic systems analysis and design software. Thus, this implementation may also 
be used for interactive modification of pilot and plant parameters, system transfer function 
manipulation, and determination of system frequency responses. 

Section 4 provides a theoretical development of the MOCM. In section 5, example results 
based upon the analysis of a tracking task using three basic dynamic systems are compared 
with measured experimental results (Kleinman, Baron, and Levison 1970) and similar analyses 
performed using the OCM and two previously proposed simplified optimal control pilot models 
(Hess 1976; Schmidt 1979). 
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Superscripts: 
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A dot over a symbol denotes a derivative with respect to time; a carat over a symbol denotes 
an estimate. 

4. Theoretical Development 

This section presents a theoretical development of the modified optimal control pilot model 
(MOCM). A block diagram of the model components of the MOCM is given in figure 1. The 
notation has been chosen to be compatible with the OCM development (Kleinman, Baron, and 
Levison 1970), To simplify the notation, this development considers the case of a single control 
input, although the algorithm can easily be extended to account for multiple inputs. 

The plant dynamics to be controlled, augmented with plant disturbance dynamics, are given 
by the state space time invariant linear equations: 

x = Ax ~b B 6 + Ew 1 

y = Cx + D<5 J (4 '^ 

where x(£) is an n^-dimensional state vector composed of both plant and system disturbance 
states, 6(t) is a scalar plant input, w(£) is an n w - dimensional disturbance vector modelled as a 
zero mean Gaussian white noise process with intensity W, and y(t) is an n^-dimensional output 
vector. 

The vector y obs (f)> of dimension n y , represents variables the pilot can perceive, either by 
observation or feel. The outputs observed by the pilot are assumed to be corrupted by an 
observation noise, v^(f), a zero mean Gaussian white noise process with intensity V^: 

y obs = Cx + D<5 + v y 

In the MOCM, the pilot’s effective time delay is modelled by a Pade approximation. The 
pilot s effective time delay is placed at each of the pilot’s outputs and is treated as part of the 
plant dynamics for determination of the pilot’s regulation and filter gains. Since typically the 
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Figure 1. Conceptual block diagram of modified optimal control model. 
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pilot is modelled as having more inputs (observations) than outputs (plant inputs), placing t le 
effective time delay at his output yields a lower order representation than placing the delay 
at his input. A second-order Pade approximation is chosen because it provides a very good 
approximation to a pure delay over the pilot’s frequency range of interest (approximately 0.1 
to 10 rad/sec). Use of at least a second-order Pade approximation is assumed to be necessary 
to accurately model pilot magnitude and phase compensation at the high end of the pilot s 
bandwidth, such as the pilot high frequency neuromotor resonant peak. Accurate representations 
of the pilot’s resonant peak and phase compensation near crossover are necessary when concerned 
with using the model to explore pilot-vehicle dynamic interactions or predict pilot workload in 
a given task (Anderson and Schmidt 1987j Paeon and Schmidt 1983). 

A second-order Pade approximation is given by 

Ud _ 1 ~ \ ( rs ) + g (ts) 2 ( 4 , 2 ) 

up 1 + \ (rs) + l (rs) 2 

where r is the delay interval (in seconds), u p is the pilot’s output, and u d is the delayed pilot’s 
output. In state space form, this can be expressed by 


x d = A d x d + B d u p 
$ = u d ~ ^d x d "h Up 


(4.3) 


where x d is a two-element vector of Pade delay states. 

The plant dynamics augmented with the pilot’s effective time delay are given by 
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(4.4a) 


or 

x s = A s x s + B s rtp + E s w 
y = C s x s + D s u p 

The pilot’s observation vector is given by 

Yobs = c « x s + D s u p + v y 

This model makes the assumption that the pilot’s control task can be defined by the 
minimization of the quadratic performance index J p given by 

J P = Eoo {y T Q y y + u 2 p r + u 2 p f } (4-5) 

subject to pilot observations y obs with cost functional weightings Q y > 0, r > 0, and / > 0. By 
defining a new state vector as 

X T — [ x s Upf 


(4.4b) 
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the system given by equations (4.4) can be expressed in a control-rate formulation (Kwakernaak 
and Sivan 1972) as 
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(4.6a) 


or 

X = A oX + B 0 u p + E c w 
y 0 bs = c ox + vj, 

The minimizing control law is obtained by application of LQG solution techniques (Kwaker- 
naak and Sivan 1972) to the augmented system (eqs. (4.6)); this leads to the full-state feedback 
relation 

u*p = SpX = -[9l, 9n, 9n+l]x = -f~ l (B 0 ) t Kx (4.7) 

where n = n x + 2 (system states plus two Pade states), x is the estimate of the state and K 
is the unique positive definite matrix solution of the Ricatti equation 


(4.6b) 


0 = (A 0 f K + KA 0 + Q 0 - KB,/' 1 (B 0 ) T K (4.8) 

where 

q __ (C s )^QyC 5 (C S ) T Q y D s 

_ (D 6 .) QyC s (D s )T QyD 6 * + r_ 

By expanding the optimal control law (eq. (4.7)) in terms of x 5 and u* 

Up = - \gu • • • 1 9n] - g n +iu* (4.9) 


and letting 


and 


1 

T i = 

9n+l 


Ip — Tp [gi , . . . , g n ] 


one obtains 

T v iip + u* = u c 

where the pilot’s commanded control u c is given by 


(4.10) 


«c = -lpX s 


(4.11) 


To account for the uncertainty of the human operator’s control input, control noise v u is added 
to the commanded control u c : 

Tr t u v + u p = u c + v u (4-12) 

where v u (t) is a zero mean Gaussian white noise process with intensity V u . As in the OCM 
development, the controller gains are assumed not to be affected by the inclusion of the control 
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noise (Kleinman, Baron, and Levison 1970). This assumption reduces the solution of the MOCM 
to a sub optimal control law. Solving for iip : one obtains 
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Combining equations (4.6) and (4.13) gives 
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or 

x = Aix + BiUc + ElWi 
Yobs = Cix "I" v y 
The current estimate of the state x is given by a Kalman filter 

j = Aix + B x u c + F (y obs - y) 

X = (Ai - FCi) x + FCix + Biu c + Fvy 


(4.13) 


(4.14a) 


(4.14b) 


(4.15) 


where 

F = Ei(C 1 ) r {Vy)- 1 

The covariance matrix of the estimation error S, is the unique positive definite solution of 
the Ricatti equation: 

0 = A 1 E 1 + Si (A0 t + Wi - Si (C!) t (V,,)' 1 CjSi (4.16) 


where Wj = diag(W,V u ) with W > 0, V u > 0, and V y > 0. 

A state space representation of the closed-loop pilot-vehicle system is given by 

Ai — Bi 

FCi Ai-Bih 

{T} = 

where li = [lp 0] and C ,5 = [0 lj. 

A block diagram of the model components of the pilot’s dynamics is given in figure 2. A 
state space representation of the pilot’s dynamics is given by 
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Figure 2. Conceptual block diagram of optimal control model. 

4.1. OCM Overview 

For reference, a brief description of the OCM is presented. A conceptual block diagram of 
the OCM is given in figure 2. For a more detailed description the reader is referred to Kleinman, 
Baron, and Levison 1970. The OCM of the pilot is based on the assumption that the pilot 
chooses the control input in such a way as to minimize the quadratic cost function: 

Jocu = E oo {y r Qj/y + u 2 p r + 

The weighting matrices in the cost function are chosen to reflect the task objectives and pilot 
physiological limitations. The human perception characteristics that are modelled involve pilot 
observations passed through a pure time delay and corrupted by white noise Wy\ 

y 0 bs (0 = y (t-T) + v y (t-r) 

The solution to this optimization problem yields a Kalman filter to estimate the delayed 
states and a least-mean-squares predictor to obtain a current estimate of the states x. The 
control law, obtained from minimizing the cost function JoCM f° r a scalar control input u p is 
given by 

r v u p -\- Up — u c (t) + v u (t) 

«c (*) = ~ k OCM X (0 

where Kqcm is the optimal pilot control gain vector and is the pilot neuromotor lag obtained 
by including control rate in the cost function. 

The MOCM is based on the same premise as the OCM- the assumption that the well-trained 
and motivated human controller adjusts his compensation, subject to human limitations, for a 
given vehicle and task to minimize an objective function. Similarities to the OCM structure 
include a linear quadratic solution for the pilot gains with inclusion of control rate in the cost 
function, a Kalman estimator, and the ability to account for attention allocation and perception 
threshold effects. The major difference between the OCM and the MOCM is the replacement of 
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the linear predictor of the OCM by the augmentation of the system dynamics with the pilot s 
effective time delay before calculation of pilot control and estimation gains. This difference 
allows for the direct calculation of the pilot and system transfer functions in pole-zero form in 
the MOCM. 


4.2. MOCM Pilot Parameters 

The pilot cost function weighting matrices Q and r are chosen to reflect the pilot task 
objective. Values for effective time delay, neuromotor lag, observation, and control noise 
intensities are chosen in the same manner as for the OCM (Kleinman, Baron, and Levison 
1970). Appropriate values of neuromotor lag r ?? are obtained by appropriate choice of pilot cost 
function control-rate weighting /. Manual control experiments have shown that the effective 
time delay of the pilot r is typically 0.1 to 0.2 second (Kleinman, Baron, and Levison 1970). 

The covariance of the observation noise V y is dependent upon the nature of the display, 
human limitations, and the pilot’s environment. Over a wide range of viewing conditions, each 
diagonal element of the observation noise intensity matrix is proportional to the variance of its 
associated observed output variable. The diagonal elements of the noise intensity matrix are 
given by 


V 


Vi ~ 


^Pyj f|i 

hi erfc (a^J <j yi \fT) 


(i = l,2, n y ) (4.19) 


where p y% is the nominal full-attention observation signal-to-noise ratio, f Vi is the fraction of 
total attention spent on the ith observation variable, a^. is the minimum observation threshold 
of the z'th observation variable, and a y . is the variance of the ith observation. Single-axis manual 
tracking control tasks have shown that, on the average, p yi = 0.01, which corresponds to a 
normalized observation noise of -20 dB (Kleinman, Baron, and Levison 1970). 

The covariance of the control noise V u is assumed to be proportional to the variance of the 
commanded control u c : 


y Ul = (*=1,2, . . . , n u ) (4.20) 

where p u is the control signal-to-noise ratio. Analyses of single-axis manual tracking control task 
experiments have shown that typically p Ui = 0.003, which corresponds to a normalized control 
noise ratio of -25 dB (Kleinman, Baron, and Levison 1970). 

4.3. MOCM Algorithm Implementation 

The MOCM algorithm is organized into four major parts. The first part involves augmen- 
tation of the plant and disturbance dynamics with a Pade approximation of the pilot’s effective 
time delay. The second part is the calculation of the pilot’s control gains, where iteration on 
the cost function control-rate weighting is usually required to achieve the desired value of pilot’s 
neuromotor time constant. The third part is the calculation of the pilot’s estimation gains. This 
requires the calculation of observation and control noise covariances to yield desired signal-to- 
noise ratios for the pilot model. At this step, the observation noise covariance may be adjusted 
to take into account pilot scanning behavior and observation threshold effects. The fourth part 
involves formation of pilot and closed-loop system matrices and calculation of transfer functions, 
frequency responses, and statistics of interest. A conceptual flowchart of the MOCM algorithm 
is given as appendix A. 

The structure of this model is designed for easy implementation in current dynamic systems 
analysis and design software. Implementation in this type of computer software environment 
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allows for rapid calculation of pilot and system transfer function descriptions from state space 
models, determination of system frequency responses, and easy manipulation of system state 
space and frequency domain representations. Also, this environment allows users to interactively 
modify various pilot and plant parameters and quickly ascertain the impact of these changes on 
pilot/closed-loop performance. 

Section 5 presents an evaluation of the MOCM by applying it to model the piloted dynamics 
of a compensatory tracking task. 

5, Model Evaluation 

In this section, experimental results based upon the analysis of the closed-loop performance 
of a pilot in a tracking task for three basic dynamic systems presented in Kleinman, Baron, 
and Levison 1970 are used as a benchmark to determine the merits of the MOCM. The analysis 
obtained with this model is compared with similar analyses performed with the OCM and two 
previously proposed LQG based pilot models — an LQG approximation to the OCM presented 
by Schmidt (LQG model) (Schmidt 1979), and a pilot model proposed by Hess (Hess model) 
(Hess 1976). The LQG model includes a control-rate term in the pilot cost function and a 
Kalman estimator but does not include an explicit model of the pilot’s effective time delay. The 
Hess model does not include a control- rate term in the pilot’s cost function but does include a 
Kalman estimator and a modelling of the pilot’s effective time delay. In this model, the pilot’s 
neuromotor dynamics are modelled by a first-order lag at the pilot’s output. A description of 
these models is given in appendixes B and C. Also, the impact of changing the order of the 
Pade approximation (approximation of pilot’s effective time delay) upon the MOCM results is 
presented. 

Descriptions of the three basic dynamic systems, the tracking task, and parameters chosen 
for the modelling analysis are presented next. This discussion parallels that in Kleinman, Baron, 
and Levison 1970. 

5.1. Experimental Setup 

The compensatory tracking task performed and analyzed by Kleinman, Baron, and Levison 
used three basic command systems— a velocity command system, an acceleration command 
system, and a position command system. In these experiments, the human controller had a 
single control manipulator and observed tracking error on a display. The assumption was made 
that the pilot could determine tracking error rate information from the tracking error display. A 
system disturbance, composed of a sum of sinusoids, was applied as a velocity disturbance for the 
velocity and acceleration command tasks and as a position disturbance for the position command 
task. The amplitudes of the sine waves were chosen to simulate a first-order noise spectrum for 
the velocity disturbance and a second-order noise spectrum for the position disturbance, both 
with a break frequency of 2 rad/sec. In these tracking tasks, the human controller was instructed 
to minimize mean-square tracking error. A more complete description of the experimental setup 
is given in Kleinman, Baron, and Levison 1970 and Baron et al. 1970. 

5.2. Task Modelling 

For the pilot modelling analysis of the three tracking experiments, the pilot’s objective 
function J p was modelled as 

Jp — Eqq (e 2 + /6 2 j (5.1) 

where e is pilot tracking error. The system input disturbances were modelled as a white noise 
process passed through a first-order low pass filter for the velocity and acceleration command 
dynamics and passed through a second-order low pass filter for the position command dynamics. 
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A summary of the pilot model input parameters for analysis of each of the plant dynamics is 
presented in table I. Identical values were used for the analysis performed with the OCM an 
LQG models. For the Hess model, identical input values were used with the exception of control 
weighting, which was chosen to match the rms error statistics of the experimental data. Since 
this is a single-axis task using a single display indicator, the effects of attention allocation anc 
thresholds were assumed small and were not modelled. 

Table I. Pilot Model Input Parameters 


Input 

parameter 

Velocity 

command 

Acceleration 

command 

Position 

command 

Effective time delay, r 

0.15 sec 

0.21 sec 

0.15 sec 

Neuromotor lag, a 

0.08 sec 

0.1 sec 

0.11 sec 

Observation noise ratio , p y 

-20 dB 

-20 dB 

-20 dB 

Motor noise ratio, p u 

-25 dB 

-25 dB 

-25 dB 


^ciist _ 1 ^ 

w s + 2 

1 

^dist 1 

System disturbance 

w ~~ s + 2 

W s 2 + 4s + 4 

Disturbance intensity, W 

8.8 

0.217 

10.0 

Objective function observation weights, Qy 

diag(l,0) 

diag(l,0) 

diag(l,0) 

Objective function input weights, r 

b 0, 0, 0, 0.034 

6 0, 0, 0, 0.01 

6 0, 0, 0, 0.0012 


“Cost function weighting / is chosen to achieve desired t v in MOCM, OCM, and LQOCM. 
6 MOCM, OCM, LQOCM, HOCM. 


5.2.1. Velocity command system. The dynamics of the system to be controlled in transfer 
function form are given by 

£ _ t (5.2) 

6 s 

with k = 1. The velocity disturbance was modelled by white noise passed through a first-order 
filter with a break frequency of 2 rad/sec: 


^dist _ 1 (5.3) 

w s + 2 

In state space form, the combined plant and disturbance dynamics, expressed in terms of system 
disturbance and command tracking error, are given by 


f ^dist 

dt \ e 


-2 0 

1 0 


r dist 




6 + 


w 


(5.4) 


The observed system outputs are given by 

yobs = {e} = 

where e and e are pilot tracking error and pilot tracking error rate, respectively. 
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With the MOCM, a transfer function description of the human pilot’s compensation can be 
determined directly from the state space description, relating the two inputs to the pilot, e and 
e, to the single output, <5, as follows: 


6 = H Se e + H 6i ,e (5.5) 

where H^ e and Hfe are pilot tracking error to 6 and pilot tracking error rate to 5 transfer 
functions, respectively. Since the II be and II ^ transfer functions are not directly measurable, 
an equivalent transfer function must be formed for comparison with the measured data. The 
equivalent pilot transfer function is given by 


“ ~ 5e + s ^6e 


(5.6) 


5.2.2. Acceleration command system. For the acceleration command system, the dynam- 
ics of the system to be controlled, in transfer function form, are given by 

9 k 


with k — 1. The disturbance to the system was modelled as a velocity disturbance by passing 
white noise through a first-order filter with a break frequency at 2 rad /sec: 


^dist _ 1 

W S + 2 


In state space form, the combined plant and disturbance dynamics are given by 
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(5.8) 


The observed system outputs are 


yobs — 


0 1 0 
1 0 1 



+ v„ 


where :r L is a plant state. 


5.2.3. Position command system. In order to reduce high frequency noise, the pure gain 
dynamics of the position command system were approximated by a low pass filter with a break 
frequency at 40 rad/sec. Therefore, the plant dynamics to be controlled are given by 


9 _ 40 

6 ~ s + 40 


(5.9) 


The position disturbance was modelled by white noise passed through a second-order filter with 
a break frequency of 2 rad/sec and a damping of unity: 


•^dist _ 1 

w s 2 + 4s + 4 


(5.10) 
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In state space form the combined plant and disturbance dynamics are given by 


d 

dt 



0 

1 

0 

f ^distj 1 

' o ' 


'o' 

-4 

-4 

0 

S ^dist2 f 

0 

8 + 

1 
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0 

-40 

{ *3 J 

40 


0 
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The observed system outputs are 


fe\ 

10 1 


^disti 1 

" o ' 

y ° bs 1 e | 

0 1 -40 

\ 

j :c dist 2 f + 

4° 

J 
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l x 3 J 



where x^ist, is a disturbance state and £3 is a plant state. 


(5.11) 


5.3. Discussion of Examples 

The measured human-describing functions and model-based analysis results obtained for the 
velocity command system are given in figure 3. For this command system, the MOCM pro- 
vides a very good prediction of the measured magnitude and phase in the frequency range from 
approximately 1 to 30 rad/sec. Note also that the MOCM prediction provides an accurate mod- 
elling of the pilot’s neuromotor resonant peak. The measured human-describing functions and 
analysis results obtained for the acceleration command system are given in figure 4. The MOCM 




Figure 3. Measured human-describing functions and 
model-based pilot transfer functions for velocity 
command system. Measured data from Kleinman, 
Baron, and Levison 1970. 




Figure 4. Measured human-describing functions and 
model-based pilot transfer functions for acceleration 
command system. Measured data from Kleinman, 
Baron, and Levison 1970. 
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provides a very good prediction of the measured magnitude and phase in the frequency range 
from approximately 1 to 20 rad/sec. The measured human-describing functions and model- 
based analysis results obtained for the position command system are given in figure 5. For this 
command system, the MOCM provides a fair prediction of the measured magnitude and a very 
good prediction of the measured phase in the frequency range from approximately 1 to 20 rad/sec. 
As can be seen from figures 3 through 5 the model-based pilot transfer functions obtained with 
the MOCM compare very favorably with the predictions of the OCM for each command system. 
Also, overall the MOCM provides a better match to the measured human-describing functions 
than either the LQG model or the Hess model for the given pilot model input parameters. (The 
reader should note that a better match to the measured human-describing functions may be 
possible with the LQG and Hess models by varying the pilot model input parameters.) 

Measured and model-based rms pilot performance is presented in table II. As can be seen, 
the model-based rms pilot performance obtained from the MOCM analysis is in good agreement 
with the measured rms statistics for each task. The OCM also provides a favorable match to 
the measured rms performance. Pilot transfer functions obtained from the MOCM analysis are 
presented in table III. 

The effect on the pilot transfer function for the velocity command system of replacing the 
MOCM s modelling of the pilot’s effective time delay (a second-order Pade approximation) with 
a first- and third-order Pade approximation is presented in figure 6. As can be seen, at least 




Figure 5. Measured human-describing functions and 
model-based pilot transfer functions for position 
command system. Measured data from Kleinman, 
Baron, and Lcvison 1970. 




Figure 6. Modelling pilot’s effective time delay by var- 
ious Pade approximations and measured human- 
describing functions for velocity command system. 
Measured data from Kleinman, Baron, and Levison 
1970. 
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a second-order Pade approximation is required to capture the pilot’s high frequency dynamic 
compensation characteristics in this task. This tends to suggest a connection between the pilot’s 
effective time delay and high frequency neuromotor resonant peak. 

Table II. Measured and Model-Based rms Pilot Performance 


Data 

Velocity command 

Acceleration command 

Position comn 

nand 

Error 

Error 

rate 

Control 

Error 

Error 

rate 

Control 

Error 

Error 

rate 

Control 

Measured 0 

0.36 

1.76 

2.05 

0.12 

0.32 

1.20 

0.36 

2.19 

0.73 

MOCM 

0.34 

1.75 

1.97 

0.12 

0.33 

1.17 

0.27 

2.26 

0.47 

OCM 

0.34 

1.72 

1.94 

0.11 

0.32 

1.07 

0.27 

2.28 

0.47 

LQG model 

0.14 

1.03 

1.63 

0.07 

0.23 

0.87 

0.16 

2.22 

0.52 

Hess model 

0.36 

1.53 

1.70 

0.12 

0.28 

0.68 

0.36 

6.14 

0.55 


“Measured rms pilot performance data taken from Kleinman, Baron, and Levison 1970. 


Table III. Summary of MOCM Pilot Transfer Functions 


Command 

Model-based pilot transfer functions 
(a) 

Velocity 

f, 181. 2(3.26)(6.37)(12.74)(-0.707, 18.86) 

e ~ (1.99)(6.44)(12.49)(0.264,20.99)(35.33) 

Acceleration 

t 443. 3(0. 47) (2. 32)(3.29)(10.03)(— 0.707,13.47) 

e — (2.00)(3.22)(9.99)(0.256,10.08)(0.820, 18.22) 

Position 

K 10.19(4.14)(9.14)(11.55)(— 0.707,18.86)(40.70) 

e ~ ( 1 .45) (2.80) (9. 10) ( 1 1 .37) (0.389, 24. 76)(71 .65) 


“( ) = Real pole or Zero; ( , ) = (£,w) = Damping and 

Frequency of complex pole or zero pair. 


6. Concluding Remarks 

This paper has presented a modified optimal control model (MOCM) based upon the optimal 
control model (OCM) developed by Kleinman, Baron, and Levison (Automation, May 1970). 
This model is input compatible with the OCM and retains other key aspects of the OCM, such as 
the linear quadratic solution for the pilot gains with inclusion of control rate in the cost function, 
a Kalman estimator, and the ability to account for attention allocation and perception threshold 
effects. An algorithm designed for easy implementation in current dynamic systems analysis 
and design software has been presented. Implementation in this type of environment allows for 
rapid calculation of pilot and system transfer function descriptions from state space models, 
determination of system frequency responses, and ease of system state space and frequency 
representations. 
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The MOCM was used to predict closed-loop pilot performance in a compensatory tracking 
task for three basic dynamic systems. These predictions were compared with measured pilot 
performance and shown to provide a very good modelling of both pilot-describing functions and 
time domain performance statistics for these dynamic systems. Also, the predicted models 
obtained with the MOCM were compared with similar analyses performed with the OCM 
and two previously proposed LQG (linear quadratic Gaussian) based pilot models— an LQG 
approximation to the OCM and a model proposed by Hess. The MOCM is shown to provide 
results very similar to those of the OCM and to compare more favorably with the measured pilot 
performance than the other pilot model predictions. 

In this formulation, use of at least a second-order Pade approximation is required in order 
to accurately model pilot magnitude and phase compensation at the high end of the pilot’s 
bandwidth, such as the pilot high frequency neuromotor resonant peak. This tends to suggest 
a connection between the pilot’s effective time delay and high frequency neuromotor resonant 
peak. 


NASA Langley Research Center 
Hampton, VA 23681-0001 
August 13, 1992 
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Appendix A 

Modified Optimal Control Pilot Model Flowchart 



Yes 

_J: 

Augment system with lag 
dynamics 
(eqs. (4.14)) 
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Appendix B 


LQG Approximation to Optimal Pilot Model 

This appendix presents a theoretical development of an LQG approximation to the optimal 
pilot model (Schmidt 1979). The plant dynamics to be controlled, augmented with the 
disturbance dynamics, are given by the state space time invariant linear equations 

x — Ax + Bi5 + Ew ] 

y = Cx + D<5 J (B1) 

where x(£) is an n-dimensional state vector, S(t) is an n w -dimensionaI vector of pilot inputs, 
w (t) is an n^-dimensional disturbance vector modelled as zero mean Gaussian white noise with 
covariance W, and y(t) is an n r dimensional output vector. The vector y obs (£), of dimension n y , 
represents variables the pilot can perceive, either by observation or feel. The outputs observed 
by the pilot are assumed to be corrupted by an observation noise v y (£), a zero mean Gaussian 
white noise process with covariance V yi as follows: 


y obs = Cx + D 6 + Vy 

The following development considers the case of a scalar pilot input 6. 

The pilot s control task is assumed to be modelled as the minimization of the quadratic 
performance index J p given by 


Jp — E 0 


{y T Q2/y + 6 T rS + f) T fs} 


(B2) 


subject to pilot observations y obs with cost functional weightings Q y > 0, r > 0, and / > 0. 
By defining a new state vector as 

X T = [x 6f 

the augmented system can be expressed in a control-rate formulation as 


d 

Tt 




A B 

0 0 

y = [c 


{JH! 


<5 + 


w 


or 


X = A 0 x + B„<5 + E 0 w 
y = c 0 y 
y 0 b S = Cox + v y 


(B3a) 


(B3b) 


The minimizing control law is obtained by application of LQG solution techniques to the 
augmented system. This leads to the full-state feedback relation 


^ SpX [<7l> - --j dm 9n+l]x — ~~f (®o) K x 


(B4) 


where x is estimate of the state X an d K is the unique positive definite solution of the matrix 
Ricatti equation 

0 = (A 0 ) r K + KA 0 + Q 0 - KBof - 1 (B 0 ) r K (B5) 
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where 


Qo — 


C T Q yC 
D T Q y C 


C T QyD 

D T Q y D + r 


By expanding the optimal control law in terms of x and <5 


6 = — \gi , <?n] X 9n+ 1^ 


and letting 


and 


1 

t t] = 

9n + 1 


lp — Tjj [^l? ■ * • > 9n] 


(B6) 


then 


t„6 + 8 = u c 


where the pilot’s commanded control Uc is given by 


Uc — 1/jX 


(B7) 


(B8) 


To account for the uncertainty of the human operator’s control input, control noise v u is added 

to the commanded control u c t 

r T} S + <5 = u c + v u 


leading to 

6 = —6 + -u c + -v u (BIO) 

Tr, T r , T v 

where v u is a zero mean Gaussian white noise process with covariance V u . By combining this 
result with the original control-rate formulation, one obtains the augmented system 


d 

elt 



A 

0 


B 

— I/ 7 *? 



u c + 


E 

0 


Yobs 




(Blla) 


or 


X 


Aix + Biu c + Eiwi 

Yobs ~ Cix + Vj, 


The current estimate of the state is given by a Kalman filter 


X = A lX + B l u c + F (y 0 b s - y) 
j = (Ai - FCi) x + FCix + Bju c + Fv y 


(Bllb) 


(B12) 


where 


( V ,;)' 1 


The covariance matrix of the estimation error £1 is the unique positive definite solution of 
the matrix Ricatti equation 


0 = Ai£i + Si (Ai) T + W 1 -S 1 (Ci) T (V„) 1 C 1 S 1 (B13) 
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where Wj diag(^V, V u ). A state space representation of the closed-loop system is given by 

Ml ] / * 1 . [ E i 0 ] f wj 1 

ll-FC 1 j\xJ + [ 0 Fj\v y / 


d J X 

di 


Ai — Bj 

FCi A r -Bili 


| y 0 bs \ _ 


H°.' -1, !{?}*{?} 


where li — [Ip 0]. A state space representation of the pilot's dynamics is given by 

{?F Al 


d 

Tt 


FCi-Bih 0 1/xl ,[ F " 

- 1 /% -l/r v J \ 6 J 0 


y + 


<5 = [o 1 


{?} 



or 


Xp — ApXp + B p y -f- EpVp 


6 — CpXp 


(B14) 


(B15a) 


(B15b) 
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Appendix C 


Hess’s LQG-Based Pilot Model 

This appendix presents a theoretical development of Hess’s LQG-based pilot model (Hess 
1976). The plant dynamics to be controlled, augmented with the disturbance dynamics, are 
given by the state space time invariant linear equations 

x = Ax + B5 + Ew 1 

y = Cx + D5 J 

where x(t) is an n-dimensional state vector, <5(£) is an n u -dimensional vector of pilot inputs, 
w (i) is an n^-dimensional disturbance vector modelled as zero mean Gaussian white noise with 
covariance W, and y (f) is an n y -dimensional vector of outputs. The vector y obs , of dimension n y 
represents variables the pilot can perceive, either by observation or feel. The outputs observed 
by the pilot are assumed to be corrupted by an observation noise v y (f), a zero mean Gaussian 
white noise process with intensity V y : 

Yobs = Cx + D5 + v y 


The following development is for the case of a scalar pilot input 6. 

The pilot’s effective time delay is modelled by a second-order transfer function given by 

ud _ (f ~ 4 / t ) 2 (C2) 

U C (s + 4/t) 2 


where r is the delay interval, u d is the pilot’s delayed control input, and u c is the pilot’s 
commanded control. In state space form, this is expressed as 


d { x dl 1 

Tt \ *d2 J 

► = 

0 — 16/r 2 1 fxdil 

_ 1 — 8/t J \ x d2 J 

° 1 
- 16 /tJ 

Uc | 


Ud = [a 1 1 { S } + 


) 


(C3) 


where is a delay state. 

To account for the uncertainty of the human operator’s control input, control noise is added 
to the pilot’s delayed control input 

u n = U d + v u ( C4 ) 

where v u is a zero mean Gaussian white noise process with covariance V u . 

The pilot’s neuromotor dynamics are modelled as a first-order lag given by 


= 1 (C5) 

Uj 7 . TfjS + 1 

The effective time delay and first-order neuromotor lag are placed at the pilot’s output and are 
treated as part of the plant dynamics for determination of the pilot’s regulation and filter gams. 
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The combined time delay and lag dynamics, in state space form, are given by 


d 

It 


1 

x d2 , 

|-f 

l « J 

1 


0 

— 16 /r 2 

0 

[ Xrfl | 


0 


0 


1 

-8 /r 

0 

\ x d2 , 

> + 

— 16/r 

u c + 

0 

Vu 

0 



l * J 


. l / T V . 


M t u. 



6 = [0 0 1 



(C6a) 


or 


(C6b) 


x d = A d x d + B d u c + E d v u 1 

$ = C d x d J 

The plant, augmented with the neuromotor lag and effective time delay dynamics, is given by 


d 

a? 


X 

x d 


A BC d 

0 A d 


x 

x d 


+ 


0 

B d 


Ur + 


E 0 

0 E rf 


{:}) 


y = [C DQ 




(C7a) 


or 


x A . = A 6 x s + B,u c + E s wi ' 

y = C A x s l (C7b) 

Yobs C! S X A + Vy > 

The pilot’s control task is assumed to be modelled as the minimization of the quadratic 
performance index J p given by 


Jp = E 0 o |y r Qyy + (u c ) T ru c } (C8) 

subject to pilot observations y obs , with cost function weights Q y > 0 and r > 0. The 

minimizing control law is obtained by application of LQG solution techniques to the augmented 
system. This leads to the full-state feedback relation 

U C = -gpX s = -r -1 (B a ) t Kx s (C9) 

where x iS is the estimate of the state x 5 and K is the unique positive definite solution of the 
matrix Ricatti equation 


0 = (A,) r K + KA S + Q - KB s r _1 (B A ) T K 


where Q = CjQ y C s . 

The current estimate of the state is given by a Kalman filter 

x 5 = A. s x s + B s u c + F (y obs - y) 
x A = (A s - FC S ) x s + FC 6 -x s + B s u c + Fv y 

where 

F = E(C s ) t V- 1 


(CIO) 


(C11) 
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The covariance matrix of the estimation error 5] is the unique positive definite solution of the 
matrix Ricatti equation 


0 = A + S (A S ) T + Wi - E (C s ) T V y J C S E 


(C12) 


where Wi = diag(W, V u ). 

A state space representation of the closed-loop system is given by 


d 

c[t 


x s 


As 

FC S 


— B 
B 


B s gp ] / x .s \ , r e.s ° l f w i \ ) 

•sg P - FCs J \ x s J 0 F J I v y J | 


{ y *} = 


C s 0 

0 —g p 


{£} + [o' 


A state space representation of the pilot’s dynamics is given by 


d 


{*;}= 


A $ — Bsgp FCs 0 

-Brfgp A d 

« = [0 C, 




y + 


or 


Xp — ApXp -f- B p y + EpVp 

6 = C p Xp 


F 0 

0 E d 




(C13) 


(C14a) 


(C14b) 
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